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ABSTRACl 



This thf>c;^s is a sun^naf'v of the design and 

ir'oler^entation of an ore rati no systofn interface and a user 
interface for an i t e r a c 1 i v e o r a o i c s d i s r> 1 a y s y s t e . The 
actual interface software and docurentation are 

characteristic of the Naval Postgraduate School 

e n V i r o n n f' n t . Documents d e s r r i h i n o t h actual s n f t w a r e and 
user interface are ouhlished separately* 

The cie^^eral nr ol^lems and solutions involved in 
irnr^lementina a real-tin^- interactive Graphics process in a 
multiorooramrrino environment are include (f hereir'>* Thr> 
problems and solutions discussoo are related to the 
interface of a Vector General Graphics Display Unit and a 
Digital Eouipment Corporation PDP-'ll/SO computer* 

Recomfrendations for possible future developments are also 
included. 
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I 



IMTRODUCT ION 



The problem adoressed in this thesis is how to 
5 u p> p o r t f in a m u 1 t i p r o 0 r a m m i o q n v i r o n m e n t , a r> r o c e s s that 
does not cor^form to multiproqrarrminq corwentions. Fc'iur 
basic problems are identified in general and related to a 
specific interactive o r a p h i c s e n v i r o n rr- e n t i which they 
occiir. The four Droblem areas are: 

A, Operating System N'odifications 

B, Interrupt Interface Techniques 

C, User Interface techniques 

D, Accessino Non^Con t i guous Disolay Lists 

The vehicle used for problem identificatior'i ar'xl sol l; lion 
development was 1 e vector General Interactive Graphics 
Display System I Si and a D i o i t a 1 Equipment Corporation 
fH) P '*• 1 1 / S 0 computer ( 1 7 / 1 tt 1 * T f i e UNIX T i rr e s h a r i n q System 
IPOl provideti the multi proa r a mmina envirof'tment. 

The Vector General Interactive Graphics Display System 
(Vector General)^ as installeri at the iL'aval Postgraduate 
Schoolf is a highly sophisticated display terminal with 
hardware implemented three dimiensional rotation^ 
translatioof and scalino (51. An alphanumeric keyboard 
(Ilf lichted function switches with manual interrupt [^If 
control dials (?lf ana light pen 1121 are attached to the 
system. A circle- a re generator (31 and a character 
qef'ierator [61 are included as an integral part of the 
system. This graphics display system is interfaced with a 
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PDP-ll/SO CO ^router hoving 6^K byte?J of morrorv and two 
rpillion bytes of dis< storage.. This thesis discusses some 
of the problems involv'Cd iri imolen - anting an interactive 
Graphics interface and includes recommendations for 
possible future developments in the area of supoortino 
non-ccnforniino processes in a multinrogranmino 

environment. A detailed d6:scription of the actual 
interface desioned and innlemented in the course of this 
thesis can be founri in separate publications fl'^rWO. 
Those publications include a ci e s i q n mt a n u a I # u s e r' s m a n u a 1 r 
pf'ooram listings^ and documentation. The interface is a 
partial result and extension of an ir^itial interface 
design by Howard and Thorpe I7»8)e 

II. CHAPACTLRISTTCS of MULTIPROGRAf/PING PRQCFSGLS 

Multiproararnming is the interleaved or concurrent 
execution of two or more processes fM). Since the 
physical memory reauiremer^ts of each process ray vary^ 
each process is designed to relocated within memory. 
This enables a process to t)e reassigned within memory as 
necessary to ensure efficient memory utilization. 
Processes waiting for a system resource are typically 
sw aoped onto a mass storage device theret'^y releasing the 
physical memory for another process. In som-e systems a 
process may be divided into segments or rages that are 
themselves relocatable and swapoable entities. 
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A frultioroqramming proces?; typically is not oiven 
dpdicat€?d use of the central prc>cessor. f.ach process is 



executed 


for a 


tiri'C Quantum and then 


set to a w a i 


t state. 


Processes 


waiting to be executed are 


placed in 


a oupue 


ac CO rcH nc5 


to 


some predefined 


priori t y . 


This is 


c h a r 0 c t e r 1 


Stic 


of computer systems 


p e r mi 1 t t 1 n y 


OH"! i n e 



CO. TP unications with multiple lisers fill. 

Since the rrultioroorammina process is relocatable and 
swap a bier the user has no knowleciqe of physical rcmory 

address d urine pr'oqrorr execution. Therefore/ the user 
<4 e n 0 r a t e s his p r o a r a m in an i n • cKn‘ n a r y m e m o r v' c a 1 1 e d 
virtual memory. Each users virtual merrory begins at 
address zero and can, Oependinq on the operatifio system, 
extend to the maxi mum aedress of the computer. The 
c D e r a t i n q system maos all virtual addresses into physical 
add I' esses when the process is loaded intc') memiory. Some of 
these characteristics conflict with characteristics of an 
interactive graphics process as will be shown. 

III. CHARACl ER] STTCS Of INTERACTIVE GRAPHICS PROCESSES 
A. CRT KEFRPSH REOUIRtJ^.ENTS 

ivhile various types of graphics plotters have been 
invented/ the CRT disclay is the only device suitable for' 
generating interactive graphical output at high sr^eed 
[161. The short persistence of the CRT phosphor permits 
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information to be ouicklv chanuoa. 



This 



is also the 



r?rincio1o foilinq of the CRT. If a line is oi splayed once 
it quickly fades. The r^rot^lem can t'e remedied by 

refreshing the CRT but continual refreshing limits the 
numtier of lines that can be drawn. If too many lines are 
d i s o 1 a y e d the intensity variations of the lines will to 
n o t i c a b 1 e . This p h e n o rn e n o n ^ called f 1 i c k e r r is 

u n d e s i r a P/ 1 e a n O usually not n r m i t t f”? O , A r e f r c.^ s h rate of 

thirt\' to forty hertz will prevent flicker but dees 

require the entire display to be displayed every thirty- 
three to twentvfive millisecor^ds. If the computer 

processor m. usl pe used to directly refresh the CRT 
display^ supportino a oraohics process under a 

rr, i; 1 t i p r o q r a m m i n Q o n v i r o n rr: e n t vi o u i d be i m p r a c t i c a I . 

Recent developments in d i r e c t view s t o r a c;? e tube 
disolays and olasma oi sol ays offer a solution to the 
refresh prot>le?m but in some respects are less versatile 
than the conventional CRf, Another pooular approach to 
the problem is to builci a ser^ar«ste disf'ilav processor whose 
function is to read the com> outer’s memory and use the data 
to generate the display. Refresh orocessinq is tficn 
handled by the display processor leavir'tg the computer 

processor free to perform other tcisks. 

The display processor technique is employed t)V the 
Vector General using a Direct Memory Access channel (Df^lA) 
lbf6]. Communication with the user is maintained via a 
frame clock interrupt signal every 8.33 milliseconds. 



Usinci the time between interrupts as a timePf the 
POP- 11 /SO computer can determine when to initiate the 
Vector General for- refresh. This allows the speed and 
versatility of a conventional CK'T and removes the refresh 
Drocessino from the PDP-ll/SO nrorossor^ Ihe is not a 
panacoof however. It requir-es the display data to remain 
in the computer »^emorv for the er^tire time the data is 
beino useo for display peneration. 1‘vhile this is not a 
limitation or'i the computer nrocessorr it is a limitation 
on the computer resources. This lirriitation would not be 
not i coble in a dedicated computer enviror^nento IHoweverf 
in a multinropramminq environment c^l) computer resources 
are at a premium and and any limitations ir nosed must l)c 
consi dercd. 

B. MEMORY MANAGEML'rM 

As previously mentioned in section 11^ the central 
theme in a nultiproorammino environment is that all active 
processed may be relocatiable within memory. Procf^sses may 
also be remove or swappeo onto a rr<ass storaoe device. 
This permits efficient use of comt^uter processor time and 
computer memory. Butf this also conflicts with the DMA 
capability of the display processor. 

Before the DMA can bo usedf some method of ensurino 
the entire display list is resident in memory must bo 
found. In additionr the display list must not to be 



relocated or swapped 



These restrictionSf while necessary 



to ensure the disolnv processor can adc'iress the display 
1 i s t f must also be t i r» m i n i rr i 7 d . Only while the display 
processor is actually usino the display list for display 
qenof'ation must these restrictions apply. Thereforof some 
method of determinino which display list is active must be 
found. 



IV. GRAPHICS INTCRFACL OFS) GH 

A. OPF.RATl^iG SYSTFt’ N OD I F T C A T 1 Gi\S 

Implementation of the o r c3 p h i c s i n t e r f a c e r e u i r e d that 
the memor'y allocation scheme of ti^UX be nodified to pern it 
the Vector General Gf'aohics Display Svstem to access the 
Graphics ciisolay list. Ihe modification adopted involved 
creation cf a unique real-time Process. Whenever a user 
declares his intention to use tlie Vector Gc'neraW the 
user’s entire process is placed in physical memory and 
flaqqed as non-swaoable ar^cf non - relocatable. Followino 
the real-time j.3rocess recommorKiations of Krai {10]^ the 
process priority is also inc:reased to ensure the re airtime 
process is at the head of the r^rocess n u eue. Ihe process 
priority chanoe has been found to be necessary only if the 
computer processor is perform, i no the display refresh. It 
is not needeef with DMA and its action prevents the 
computer processor from servicinq any other process. The 
modifications implemented^ v;hile comparatively simple^ ao 
not consider memory as a limited resource nor is the time 
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m 1 n i 1 z 0 t 1 o n factor c o n s i d (? r e d • 

An alternate solution to the one innlenonted requires 
a O d i t i o n o 1 fr> o ci i f i c a t i o n s to t n e o p e r a t i n q s y s t e rr but does 

treat rrerrory as a limileci rf» source. This involves 

splitting a ur>er orocess so that the instruction soaco 
the data s n a c e are t r e a t e cf s e n ci r a t e 1 y • When a user 

declares his intention to usn the graphics ternriinalf the 
opera tinq system* places the rf^strictions only or^ the data 
space. The instruction soaco r c rr a i n s u n c h a n q o ci . This/ 
however/ still does o t. c o n s i d o r the tine m i n i n i ^ o t i o n 
factor. The user could declare his intentions to use the 
graphics terminal end then n^ver do so. Yet/ the 

resources woulci be allocated. 

If a orocess were nerrr. itted to complete all 
calculations and data manipulations i n v o ! v i n q display list 
preparation prior to l^ecomir'^o a real*"time orocf-ss/ the 
p e r i o ri of t i m ^ in which m e m c) r y is a 1 1 o c a t e d to the r o a 1 - 
time process w'ould he reduced to the actual d\ sn) ay tirre^ 
The operating system would then/ at display tirre^ locate 
the display list referenced by the display r^^ quest and 
make that list a real-^time entity. 

A thiro solution alternative is directly related to 
the capabilities of the Vector General Graphics Display 
System and the UHIV operating system. The address 
structure of the Vector (7f'neral*s D^^A channel is such that 
the display processor can dyr’^amically access only 



bytes of memory 



A display processor commanfj defines 



which 3^K bvte memory hloc^*^ is to oe o cl dressed 



The U^'iJX op eratinq systerr treats the instruction and 
data sDOCe of a process as o sinole entity with the data 
soace ac'>nonded immecfiately foHowino the instruction 

space. ] f the virtual a d d r e s s i n n s c h e rri e of U r! 1 X were 
modified so that the first address of the data space was 
virtual address zeror the rcal-tiqe process modi ficat ions 
would be simplified. At d i s o 1 a y t i rn e ^ the process c o u 1 d 
be allocated across a 3?K t>yte memory address bour'>c^a('v 
with its data space t)ed inning at the boundary address. 
Virtual addresses would then be a physical address offset 
from the address boundary. hile not providing <? 

tremendous asset for memory m, anac^emientr this solution 
would greatly enhance the Display manipluation 

c a p a b i 1 i t i e s . 

A less appealing hut easier i rr n 1 e rr e n t a t i o of the 
virtual a ci dressing modification would be to ensure the 
entire virtual address spacer instruction and data^ begins 
on a 3?K byte memory block bour'idary. The data soacf'r 
while still an address offset/ would not be virtual 
address zero. This implement ot ion would reduce the total 
available data space by the size of the instructior^^ spacn 
but the acfditional memory space used is that of the real*- 
time process. Therefore^ any address ir'jq errors within the 
Vector General would only affect the instruction and data 
space of the real-time process. 



b. irsITL kHUPT INTERFACE TFCHNIPUFS 

A nunber of Graphics devices havr beeri invented for 
the input of Graphical informatior to a conr.puter. When 
used with a oraohics disci a v^ the devices rrake it possible 
to effectively interact with the proprari. Generally/ the 
simplest way to handle inputs f rorri these devices is by 
means of interrupt routines which receive the input data 
and pass it on to user the r^roorar in the form of an 
interrupt signal [16), Since the Liscr exists in the 
relocatable process space of a vif'lural machine/ the 
o n e r a t i n a system must o r o v i ci e the 1 i k b e t w e n the 
interrupt service routine and the user iriter'rupt signal 
routine. Tf'iis operation re nu ires some effort and may take 
as much as one hundred milliseconds if the process has to 
tie retro ived from the disk. Considcrino thn freduencv of 
frame clock i n t e r r u n t s (8.3'^ milliseconds) plus the 
occurance of any rievice interrupts/ it is likelv that 
multiple i n t e r r u P t s will occur while w a i t i g for t h. e 
operating system to Process the first interrupt. 

The UNIX operating system has no capaliility of 
handling multiple interrupts nor of determining the 

priority of interrupts received from the same peripheral 
device. Because of the nature of some graphics devices/ 
only one interrupt may occur. Therefore/ it is important 
to ensure the preservation of each interrupt. The Vector 
General interface e mi ploys a technique that eliminates tiie 
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need I'O pass all but device interrupts to the user. The 
user is required to provide the interrupt service routine 
with the d e s i r e d refresh rate. 1 h i s determines the n u t) o r 
of frame clock interrupts permitted before 

reinitialization of the d i s o 1 a v list. The i t e r r u p t 
service routine then handles the refresh tininq without 
requiring any action from the ciser orcqrair. 

When a device interrupt occtirs^ the values of specific 
Vector General registers are extracted prior to askino the 
oneratino syster^ to signal the user orooram. These values 
reoresentino the interrupt state of the Vector (^enerc'il are 
r e t a i e d by the device i n t e r r u p t service r o u t i n e until the 
user program explicitely asks for the valuos. Jnclu deo in 
these interrupt vaUics is a Vector General status word 
indicating which interrupts have o c c tj r e d lb]. This 

feature enables the user to define which device has 
priority and any desired action to taken. 

C, INTERFACE TECHNItvUES 



The user interface software has been designed to rr-ake 
the detailed operation of the Vector General transparent 
to the user. The basic concept is to define hicih level 
constructs which the user interface routines convert into 
Vector General commar'ids. There are three classes of 
constructs defined: objects/ elements/ end the picture. 
An object is the lowest level construct which can be 
displayed alone. Each object is independently rotatable/ 
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seal abler and translatable into af>y portion of a thirty 
inch by thirty inch nicture so ace. An object can be as 
large as fifteen inches by fifteci'i inches ana be rotated 
or positioned to the extrerre limits of the picture space 
vn'thout distortion to any of the remiaininq visible 
portion. tach object is composed of one or more 

inoependcntly light per'* bookable elea^ents. An element is 
composed of a series of user drawn images or characters 
entirely relative to the lintransformed image soace of its 
object. An o t: j e c t can be defined u n r o t a t e d in such a v- a y 

as to fill the entire object soace and then be scaled#* 

rotated/ and moved so that the image soace is the 

appropriate si?e/ is viewed from the aporooriate aspect/ 
and is in the appropriate area of the picture. The 

Picture defines the picture scale ana screen coor'di nates 
for all objects. 

The user is resnonsiole for the generation and content 
of each element. Pf'ior to its inclusion within the 

cji splay list/ the user must fill each elerrei-it with ttie 

necessary draw and move commands. In addition/ the user 
must provide three unused words succeedino the draw^move 
commands. These three words are used by the interface 

routines to ensure eacfi element is properly terminated. 

This prevents the Vector General from, accessing n^emory 
outside the display list if the uS(^r fails to properly 
terminate the display list. 



The generation and content of all objects and the 



:^;^iBB ’Tyyinnnnnni| ' , 
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picture is the rest^cnGil^lity of the interface software. 
A set of routines are provided to link elements to objects 
and objects to the nicturc. Dyr^amic mocHfi cation of 
objects anci picture para^^eters is also provided. fHowever/- 
it is the user’s responsibility to ovnan>ical1y modify the 
element cent en t • 

D. ACCESSirJG NON-CObT IGLIOIJS DISPLAY LISTS 

One of tho basic roauirempnts of ar> interactive 
graphics system is that the picture can be ctianoecf 
dynamically. This car^ i^e done by reoencratino the entire 
display list or seomentinn the oisnlav list and 

regeneratino tfie modified segment. Sromentino the display 
list also permits sharinq of ci iso lay code in a manner 
somewhat analogous to conventional subroutines. 1his does 
require some means of oeneratinq the display from non- 
contiguous display lists. A list of tf^^e non-contiouous 
display lists could L>e created and sent to the display 
p r o c e s s o r or t fi e n o n ^ c c n t i chj o u s display lists c o li I d be 
linked within the display list itself. The Vector General 
is capable of both types of ooef'ation. The latter methoci 
was used for the interface implementation. This metf^od 
requires less communication with the POP- 11/5 0 computer. 

The concept of display subroutine calls implies the 
ability to store the present slate fiefore oerforminq the 
subroutine jump. This usually is implemented by a I. ast- 
In-First-Out stack [91. The f^iVA is normally a 
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bidirectional channels therefore tne display processor has 
access to the computer’s memory for manipulation of a 
stack. ^"iith aoorooriate instructions and ad ci nesses 
encoded in the d i s n 1 c3 y 1 i s t. r the display processor can n o 
access non**contiquous ciisplay lists. Reference 

contains a description of the Vector General subroutine 

stack. 

Permitting the display processor to write into menors^ 
creates a data protection oroblem in a sfiarcd memory 
environment. The display processor cannot be allowed to 
write i nd i sc r i m i no t e 1 V throuohcut memory. The inteority 
of the oneratino system ancJ other user processes must be 
rraintained. A stack area provided by the user v^'oulo 
enable the display processor to Peter mine where to ad press 
fij e' n. o r y for all write o n o r a t i o n s . H o a- e v e r r the ( A 

bypasses the opera! i no system’s uncierflov; and overflow* 

protection mechanism. There forer an addressing error 
could cause modification of the operation system or 
another user process. Some method must be used to limit 
the access range of the display processor. Bounds 

registers in the display processor is a reasonable 
solution. These registers^ set by the computer process oPf 
would limit the area of add r e s s ab i 1 i t y by the display 

processor. If the bounds reejisters applied to read as 
well as write operations/ unbounded display lists could 
also be easily detected. The Vector General’s byte 

memory addressing limitation is analogous to a set of 
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fixed t)Ounda ry r c s i* 5 t e r s » 



Since the typical ci is ploy list 



(Joes not reouire the full 3?K bytes of menoryf the display 
processor does have the ootential of addressing outside 
the real-time process* The Vector General inter' face 
routines minimi /e the problem in three ways* First/ the 
user himself does not define the subroutine stack nor does 
he use the subroutine stack directly. This is handled by 
the interface routines. Second/ the stark has a soft a re 
underflow mechanism provided by trio interface routines. 
An underflow traos to a Vector General halt instruction. 
Third/ each display list is t e r m i n a t e ci in such a manner 
that the disolav list cannot be accessed beyond its 
ci e f i n e c.i 1 e n q t h . 

Realistically/ there is no v) a y to share the sane 3 K 
byte memory block with a Vector General nroc(?ss and ensure 
one hundred percent integrity. A user coulci inclucie 
commands in his display list that cause an uncietecteci 
stack overflow or a jump to an area outside of the process 
limits. The Vector General instructions defining ttiese 
actions are not make available to the user but a disp>lav 
error could result in such an instruction. 
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VI 



f^ECOMMLMPAT TONS 



A. Urax N'ODIFICATIOMS 

!• Process Priority 

1 h e c u r r‘ e n t i p 1 e n e n t a t i o n of the i t e r a c t i v o 

graphics interface reouires each process requesting use of 
the Vector General to change its priority as part of the 
real-tirre system call. This is a necessary reouiremerit 
only for those rera*^tifne processf*s performinc) the refresh. 
The i nc r'e a seci priority ensures the real-time process is 
placed at the toc> of the process run queue. The oir^ect 
memory access capability the V(»ctor General aoes not 

require the process to refresh the oisnlay directly. 
Therefore/ the increased priority of the r'eal"-lime process 
is not n c e d e rJ for the Vector General. If the U Tv’ I X 

oner r3 ting system were nodified to allow a process to t)e 
real-time without chanoinq its pr’iority/ the affect of a 
real-time process on the multi-user environment would be 
reduced * 

2. ^'emorv Allocation 

The memory allocation scheme of UNIX presently 
requires t:?oth the instruction space and the data space to 
be loaded contiguously in memory. The only requirement 
for the Vector General real-time process is that the 
active display list (data) be locked within a 32K byte 
memory block. If a process coiild be split so only its 
data space was real-time/ the system memory resources 
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currentlv allocated ^ or the roal-tirrie process instruction 



space would be available for other uses. The size of the 
Vector General data space could also be increased/ thereby 
perrittinq 'roro complex oisploy lists. 

B. USER INTERFACr MOD T F 1 C A T 1 iS 

1 . Picture f’i o t a t i o n 

As mentioneo earlier/ the only display construct 
capable of b^^ir^q rotateo is on object. At times the user 
rri a y d e s i r c to rotate the entire r'> i c t u r- e . This capability 
should be Provided. Implementation of this feature must 
ensure the c a p a h i 1 i t y of r o t a t i n a objects is not i rr n a r e 
cf . Display Enable 

A 1 i m i t a 1 i o n d i s c o v e r e q n y c> e r s o n e 1 u s i n n the 
interface is t fi e i n a td 1 i t y to t e m p o r a r ^ 1 y prevent the 
display of an e 1 e m e t o r‘ an object w i t h o li t a c t u a 1 1 v 
deletino it from the oisidav list. The Vector General has 
this capability but it is not extencied to the user. 

3 . Increment T i n. i n q 

The proposed cesiqn interface of Howard and Thorpe 
17/Bl included a motion feature that allowed the user to 
automatically have an object move across the scree ri. The 
user defined motion vector/ usinq the frame clocF 
interrupts as a timer/ automatically incremer^ted tttp 
position of specified objects by the values of thn motion 
vector. The actual implementation could not if'* elude this 
feature because of the relationship between th^ user 






process and the frame clock inter runts. The onlv timer 
U\‘IX has provided is in increrrents of one second and that 
timer is stoDpOfi by any interrupt signals Theroforor it 
is entirely unsuited for a disf;)lav motion timer. 
Implementation of this capability would enhance the (jse of 
the Vector General and simplify the user program. 

^1. Display List Generation 

The? importance of proaramrrir^q lannuages is often 
forootten when a craohics systeri is oesi qned. The 
designer becomes involved in the issues of disolav file 
structures and oraohical in ter' action leavnr^g the Provision 
of 0 convenient prooramming 1 anouacu" until later. This 
lack of interest in t t» o ri e v n 1 o m e n t of r r o <4 r a rn rn i n a 
languages has been one of the major ot>st3c1os preventino 
the widespread use of graphics (lol. Until such a 
language is devel ope df the unfortunate proa rammer is 
forced to write in rr a c h i r'l e or s s e m b 1 y 1 a q u a g e « This 
int(?rface design has consioered only part of the problem. 
Several interface routines have been provideo to simplify 
the actual access to the Vector General. The creation of 
the display list use ci to generate pictures must still be 
accomplished in the octal machine language descril^ed by 
Thorpe { ) ^ r IS] , t3efore the existing interface will be of 
use to the general graphics programmer/ a simple mcthoo of 
generating display lists must be found. On tfiis single 
capability may hinge the success of the exist i no interface 
structure. 



as 



VII 



CONCLUiWON 



The Vector General interface ciesicned and implemented 
t:>y Thorpe is operational with no known buqs in any 

of the interface routir^es- The hardware suooort and 
direct memory access c a p a i 1 i t i e s of the Vector e e r a 1 
Interactive Graoliics Display System have been the key to a 
successful interface. i\ithout the hardware suooort it is 
questionable whether any multi-user capabilities would be 
c3 V a i 1 a c> 1 e while u s i n n the V f- c t o r Ci c r-) e r a 1 . 
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